#model optimization

Polaris-4B and Polaris-7B introduce a novel reinforcement learning recipe that scales reasoning capabilities efficiently, achieving state-of-the-art results on math benchmarks with smaller models.

Researchers introduce Effective State-Size (ESS), a new metric that measures actual memory utilization in sequence models, enhancing understanding and optimization of model performance.

ByteDance unveils QuaDMix, a unified framework that enhances large language model pretraining by jointly optimizing data quality and diversity, leading to significant performance gains.